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Abstract 

Our aim of this article is to reconstruct a signal from undersampled data in the situation 
that the signal is sparse in terms of a tight frame. We present a condition, which is independent 
of the coherence of the tight frame, to guarantee accurate recovery of signals which are sparse in 
the tight frame, from undersampled data with minimal /i-norm of transform coefficients. This 
improves the result in [T]. Also, the Zg-minimization (0 < q < 1) approaches are introduced. We 
show that under a suitable condition, there exists a value qo G (0, 1] such that for any q e (0, qo), 
each solution of the Zg-minimization is approximately well to the true signal. In particular, when 
the tight frame is an identity matrix or an orthonormal basis, all results obtained in this paper 
appeared in [13] and p6j . 

Keywords. Compressed sensing, Z?-Restricted isometry property. Tight frames, /^-minimization. 
Sparse recovery, Coherence. 

1 Introduction 

Compressed sensing is a new type of sampling theory, that predicts sparse signals can be recon- 
structed from what was previously believed to be incomplete information [2l[3ll3]. By now, appli- 
cations of compressed sensing are abundant and range from medical imaging and error correction 
to radar and remote sensing, see [5l |6] and the references therein. 

In compressed sensing, one considers the following model: 

y = Ax + z, (1.1) 

where A is a known mxn measurement matrix (with m <^n) and z € M" is a vector of measurement 
errors. The goal is to reconstruct the unknown signal x based on y and A. The key idea of 
compressed sensing relies on that signal is sparse or approximately sparse. A naive approach for 
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solving this problem consists in searching for the sparsest vector that is consistent with the linear 
measurements, which leads to: 

min llxllo subject to ll^x — wlU < e, (-Z^Oe) 

where ||x||o is the numbers of nonzero components of x = (xi, x^) S M", || • ||2 denotes the 
standard Euclidean norm and e > is a likely upper bound on the noise level ||2;||2- If e = 0, it 
is for the noiseless case. If e > 0, it is for the noisy case. We call that a vector x is s-sparse if 
||x||o < s. Unfortunately, solving (Lq^^) directly is NP-hard in general and thus is computationally 
infeasible [71[8]. One of the practical and tractable alternatives to (-Z^o,e) proposed in the literature 
is: 

min ||x||i subject to 11 Ax — ylU < e, (-^^le) 

which is a convex optimization problem and can be seen as a convex relaxation of (i^o,e)- The 
restricted isometry property (RIP), which first appeared in [5], is one of the most commonly used 
frameworks for sparse recovery via (-Z^i,e). For an integer s with 1 < s < n, we define the s-restricted 
isometry constants of a matrix A as the smallest constants satisfying 

il-5Mxg<\\Axg<il + 6s)\\xg 

for all s-sparse vectors x in R". By computation, one would observe that 

6s = max ||A:t.74T - /||, (1.2) 

Tc{l,-,n},|T|<s 

where || • || denotes the spectral norm of a matrix. However, it would be computationally difficult to 
compute 5s using (II. 2p . One of the good news is that many types of random measurement matrices 
have small restricted isometry constants with very high probability provided that the measurements 
m is large enough [3l [231 121! ■ Since 52s < 1 is a necessary and sufficient condition to guarantee that 
any s-sparse vector / is exactly recovered via (io,o) in the noiseless case, many attentions have 
been focused on 52s in the literature [TDl |TT1 |T21 US]- Candes [TU] showed that under the condition 
52s < 0.414, one can recover a (approximately) sparse signal with a small or zero error using (Li^^). 
Later, the sufficient condition on 62s were improved to 62s < 0.453 by Lai et al. [11] and < 0.472 
by Cai et al. [12|, respectively. Recently, Li and Mo [13] has improved the sufficient condition to 
52s < 0.493 and for some special cases, to 52s < 0.656. To the best of our knowledge, this is the best 
known bound on 52s in the literature. On the other hand, Davies and Gribonval i20j constructed 
examples which showed that if (^25 > 1/ \/2 , exact recovery of certain s-sparse signals can fail in the 
noiseless case. 

For signals which are sparse in the standard coordinate basis or sparse in terms of some other 
orthonormal basis, the mechanism above holds. However, in practical examples, there are numerous 
signals of interest which are not sparse in an orthonormal basis. More often than not, sparsity is 
not expressed in terms of an orthogonal basis but in terms of an overcomplete dictionary [Ij. 

In this paper, we consider recovery of signals that are sparse in terms of a tight frame from 
undersampled data. Formally, let D be a n x d matrix whose d columns Di,...,D^ form a tight 
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frame for M", i.e. 

f = Y.{f,Dk)Dk and \\f\\l = ^\{f,Dk)\' for all / G M", 

k k 

where (•, •) denotes the standard Euclidean inner product. Our object in this paper is to reconstruct 
the unknown signal / G M" from a collection of m linear measurements y = Af + z under the 
assumption that D*f is sparse or nearly sparse. Such problem has been considered in |22 [ l25 t [T ^ [T]. 
The methods in [22 1 114 1 125] force incoherence on the dictionary D so that the matrix AD conforms to 
the above standard compressed sensing results. As a result, they may not be suitable for dictionary 
which are largely correlated. One new alternative way imposing no such properties on the dictionary 
D for reconstructing the signal / from y = Af + z is to find the solution of /i-minimization: 

/ = argmin^-gjj„ ll^*/l|i subject to \\Af - y\\2 < e, (Pi,^) 

where again e > is a likely upper bound on the noise level \\z\\2- For discussion of the performance 
of this method, we would like to introduce the definition of D-RIP of a measurement matrix, which 
first appeared in [Ij and is a natural extension to the standard RIP. 

Definition 1.1 (D-RIP). Let D be a tight frame and be the set of all s-sparse vectors in M*^. 
A measurement matrix A is said to obey the restricted isometry property adapted to D ( abbreviated 
D-RIP) with constants 6s if 

(1 - ds)\\Dvg < \\ADv\\l < (1 + 5s)\\Dvg 

holds for all w € S^. 

For the rest of this paper, D is a n x d tight frame and Sg denotes the D-RIP constants with 
order s of the measurement matrix A without special mentioning. Throughout this paper, denote 
x^g^ to be the vector consisting of the s-largest coefficients of f G M'^ in magnitude: 

X[s] = argmin||j.|,,,<^ IN - ^Ib- 

Candes et al. pLj showed that if A satisfies D-RIP with 623 < 0.08 (in fact, a weaker condition 
< 0.6 was stated), then the solution / to (-Pi,e) satisfies 

11^* £ II 

11/ - /II2 < Co " V + ^1^' (1-3) 

where the constants Co and Ci may only depend on 62s- It is easy to see that it's computationally 
difficult to verify the D-RIP for a given deterministic matrix. But for matrices with Gaussian, sub- 
gaussian, or Bernoulli entries, the D-RIP condition will be satisfied with overwhelming probability 
provided that the numbers of measurements m is on the order of slog{d/s). In fact, for any m xn 
matrix A obeying for any fixed v £ M", 

F {\\\Aug - \\ug\ > 6\\ug) < ce-^'^^\ S £ (0,1) (1-4) 
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(7, c are positive numerical constants) will satisfy the D-RIP with overwhelming probability pro- 
vided that m > s log{d/s) Therefore, by using D-RIP, the work is independent on the coherence 
of the dictionary. The result holds even when the coherence of the dictionary D is maximal, mean- 
ing two columns are completely correlated. Although Canes et al. in [I] gave the sufficient condition 
on to guarantee approximately recovery of a signal via (-Pi,e), the bound on 62s is much weaker 
comparing to the case for which D is an orthonormal basis. We focus on improving it in this paper. 

Our first goal of this paper is to show that the sufficient condition on 52s above can be improved 
to 52s < 0.493. And in some special cases, the sufficient condition can be improved to 52s < 0.656. 
These results are given and proved in Section 3. Weakening the D-RIP condition has several 
benefits. First, it allows more measurement matrices to be used in compressed sensing. Secondly, 
it give better error estimation in a general problem to recover noisy compressible signal. For 
example, if 52s = 1/14, Then by j27l Corollary 3.4], 5-js < 0.5. Using the approach in [Ij one 
would get a estimation in (jl.3p with Co = 30, Ci = 62. While by Theorem 13.41 in Section 3 of this 
paper, one would get a estimation in p.3|) with Cq ~ 5.06 and Ci ~ 10.57. Finally, for the same 
measurement random matrix A which satisfies (jl.4p , a standard argument as in \24:\ [1] shows that it 
allows recovering a sparse signal with more non-zero transform coefficients. In a nutshell, weakening 
the L>-RIP condition for (Pi^s) is as important as weakening the RIP condition for classical (-/^i,e). 

Note that the /o-norm is the limit as g — >• of the /^-norm in the following sense: 

||x||o = lim WxM = lim 



Thus Zg-norm with < g < 1 can be used for measuring sparsity. Therefore, one alternative way 
of finding the solution of (-Z^ce) proposed in the literature is to solve: 

min llxIL subject to \\Ax — wl^ < e. [Ln e) 

This is a non-convex optimization problem since /^-norm with < g < 1 is not a norm but a 
quasi-norm. For any fixed < g < 1, while checking the global minimal value of is NP-hard, 

computing a local minimizer of the problem is polynomial time doable ^5j. Therefore, to solve 
(Lg^e) is still much faster than to solve (ivo,e) at least locally. Reconstruction sparse signals via 
with < (7 < 1 have been considered in the literature in a series of papers [TTl [HI [181 [HI [13 [26] and 
some of the virtues are highlighted recently. Lai and Liu [26j showed that as long as the classical 
restricted isometry constant 52s < 1/2, there exist a value qq £ {0, 1] such that for any q £ (0,go)) 
each solution of {Lg^) for the sparse solution of any underdetermined linear system is the sparsest 
solution. Thus, it's natural for us to consider the reconstruction of a signal / from y = Af -|- 2; by 
the method of /^-minimization (0 < g < 1): 



/ = argmin? jg„ ||Z)*/llg subject to \\Af-y\\2<e. {P^ 



Our second goal of this paper is to estimate the approximately error between / and / when using 
the /^-minimization {Pq,e)- We show that if the measurement matrix satisfies the D-RIP condition 
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with 52s < 1/2, then there exists a value qo = qo{52s) £ (0, 1] such that for any q S (0, go), each 
solution of the /g-minimization is approximately well to the true signal /. 

This paper is organized as follows. Some lemmas and notations are introduced in Section 2. 
Section 3 is devoted to discuss recovery of a signal from noisy data via /i-minimization. We begin 
by give some lemmas in this section. And then we discuss approximately recovery of a signal for 
the general case in Subsection 3.1 while for the special case in Subsection 3.2. Our main results 
in this section are Theorem 13. 4| Theorem 13.81 In Section 4, we discuss recovery of a signal from 
noisy data via /^-minimization with < g < 1. Some lemmas and notations are introduced at the 
beginning. Subsequently, we give the main result Theorem 14.41 and prove it. 

2 Lemmas 

We will give some lemmas and notations first. We begin by discussing some of the results of recovery 
of a signal by /o-minimization: 

/ = argmin^-gjg„ ||D*/||o, subject to Af = y. (Pq) 

Lemma 2.1. If 62s < 1; then every signal f such that ||L'*/||o < s can be exactly recovered by 
solving (Pq). 

Proof. Since / is the solution of (Pq), we have ||Z)*/||o < ||Z?*/||o < s. Then h = f — f satisfies 
||D*/i||o < 2s. Notice that = Ah = ADD*h. Thus according to the definition of D-RIP, we have 

(1 - 52s)\\DD*h\\l < \\ADD*h\\l = 0. 
Combining with < 1, we get = DD*h = h. The proof is finished. □ 
Lemma 2.2. For all u,v £ Ss, we have 

{ADu,ADv) < d2s\\Du\\2\\Dv\\2 + {Du,Dv). 
Proof. For u,v G S<j, assume that ||Dn||2 = ||-Di;||2 = 1. By the definition of D-RIP, we have 
{ADu,ADv) = ^ {\\ADu + ADv\\l - \\ADu - ADv\\l} 
< ^{il + 62s)\\Du + Dv\\l-il-52s)\\Du-Dv\\l} =52s+ {Du,Dv). 
Thus by a simple modification, we conclude the proof. □ 

Remark 2.3. Notice that when D is an identity matrix and for any s-sparse vectors u, v with 
disjoint supports, one have 

{Au, Av) < S2s\\u\\2\\v\\2, 

which is the same as ^10, Lemma 2.1]. 
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For T C {l,...,(i}, denote by Dt the matrix D restricted to the columns indexed by T, 
and write Z?^ to mean (Dt)* , to mean the complement of T in {!,••• ,d}. Given a vector 
h £ M", we write D*h = (xi, • • • • • • ,X2s, • • • ,Xd)- Let = D^^^h + D^^h + • • • D^h, where 

D^^^h = (xi,X2,--- ,2;3,0,0,--- ,0), D*^^h = (0,0,- •• , 0, x^+i, 3:3+2, •• • , 2:25, 0, 0, • • • ,0), D^^^/i = 
(0,0, • • • ,0,X2s+i,X2s+2, • • • ,X3s,0,0, • • • ,0),- • • and Dl^h = (0,0, • • • ,d,xis+i, xis+2, ■ ■ ■ ,Xd). De- 
note Tqi = Tq U Ti and T = Tq. For simplicity, we assume that 823 < 1- 

Lemma 2.4. We have 

I I 

3=2 j=2 \j=2 

Proof. By the definition of ^25 and Lemma 12.21 we have 

I I 
\\Y,ADD*T^h\\l = {ADD*t^,ADD*tM) 

j=2 i,j=2 
I 

= ^pZ)D^.^,/i||2 + 2 J2 {ADD*T^h,ADD*T^h) 

j=2 2<i<j<l 
I 

< {l + 52s)Y\\^^h^\\2 + '^ E {DD*T^h,DD*T^h) + 252s Y \\DD*tM\2\\DD 

j=2 2<i<j<l 2<i<j<l 

I f I 

3=2 \j=2 
I 

Notice that by \\h\\l = II^t 

3=0 ' 

I 

II Y DD^T.hg = \\h - DD*T,M\l = ml - 2(/i, DD*T,,h) + \\DD*T^^h\\l 
3=2 

= \\h\\l - 2\\D*^^^hf + \\DD*T^^h\\l = J2 \\DT,hf2 - + \\DD*Toih\\l (2-1) 

3=2 

Therefore, we get 

I I f ^ V 

WY^DD^T^Hl < Ell^^:,^^ll2-|I^To,^lli + P^Toi/i|li + '^2s j;i|I?T,/i||2 (2.2) 
3=2 3=2 \j=2 J 

I 



't,/i||2 



'T,'T'\\2 



3=2 \j=2 

where we have used \\DD^,h\\2 < \\D^,h\\2,j G {0,1,- --O- □ 
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Lemma 2.5. We have 

I III 



\\Y,ADD*T^h\\l - \\ADD*T,Ml < J2 \\D*T,h\\l + | ) " (1 " S2s)\\D*tJ 

i=2 i=2 

Proof. By the definition of 62s and (j2.2p . we have 

I 

\\Y,^DD*TM\\l-\\ADD*T,,h\\l 
i=2 

< \\Y,^DD*TM\\l-{l-62s)\\DD*r,,h\ 



i=2 
I 

i=2 

2 



Z / Z 

< Ell^T,/i|l2 + '^2J 5]||I?T,/i||2 I +<52.||^I?Toi/i|li-pTo,^lli 
i=2 \J=2 



i=2 \j=2 



□ 



3 Recovery via /i-minimization 

In this section, we are concerned with the reconstruction of a signal / from y = Af + z hy the 
method of /i-minimization: (-Pi,e). 

Let h = f — f , where / is the solution of {Pi,e) and / is the original signal. We use the same 
assumptions as in Section 2. Furthermore, rearranging the indices if necessary, we assume that the 
first s coordinates of D*f are the largest in magnitude and ^ |2;|s+2 > • • • > \xd\- For the 

rest of this section, we will always assume that = w^^-^^ for some nonnegative 

number oj G [0, 1]. Then we have X^j=2 ll-^Tj^lli = (1 ~ Sj=i ll-^T,^lli- 
Lemma 3.1. We have 

I 

j=2 \i=i 
Proof. By the simple inequality 



^\xjf < ma^Jxj\J2\xj\, 
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we have 

2 



i=2 j=2 ^ \j=l 



□ 



Lemma 3.2. We have 

J=2 V=2 / \j=l 

Proof. By [211 Proposition 1], we have 

s'/^\\D*TM\\2<\\D*TMh + s{\xjs+i\-\x,s+s\)/'^, J=2,--- 
Therefore, we have 

III I 
s'/' J2 m,hh < E + s|x2.+i|/4 < J2 \\DtM\i + \\D*nhh/4 = (1 - 3^/4) J] ||I)f,^,/i|h 

j=2 j=2 j=2 j=l 

Combining the above inequaUty with Lemma 13.11 one can finish the proof. □ 

Since / is a minimizer of (-Pi,^), one gets that 

ll^*/lli>P*/lli. 

That is 

Pr/lli + Pt^/IIi > Pr/lli + WDhfh- 

Thus 

mfWi + mcfh > \\D*rf\\i - mhh + mch^ - mcfh. 

This imphes 

I 

Y,\\D*TMh<2\\D*TJ\\, + mh\\,. (3.1) 

According to the feasibihty of /, Ah must be small: 

\\Ah\\2 = \\Af - Afh < \\Af - y\\2 + \\Af - yh < 2e. (3.2) 



3.1 General signal recovery 

For 52s < 2/3, denote that 

Ps 



4(l + 552.-4<52j 



\j (l-52s)(32 - 2552.)' 
By a easy computation, one can show that if 52s < (77 — \/l337)/82 0.4931, then ps 
Lemma 3.3. If 52s < 0.4931, then 

Proof. By Ah = Yl^j=oADD^^h and we have 

I 

= \\Ah-^ADD*T^h\\l-\\ADD*r,,hf2 



J=2 
I 

< (2e + \\Y,ADD*T^h\\2f - \\ADD*T,,h\\l 

= 4^2 + 4e|| ^^Z)Z)^,^./i||2 + \\^ADD*tM\\1 " P^^To./^lli 

j=2 j=2 



Applying lemmas 12.41 and 12.51 to the above inequality yields 



where 



I I I 

Y,\\D*^h\\l + 52s\Y.W^h\\2 
i=2 \i=2 



Using 



1* ^ ||2 I II 7^* u I|2 

\D*T,M\l = mM\l + \\DTMl> "' 



\D*T,h\\l + \\D*Th\\l 



to (13. Sp . one can get 



* i,l|2 
1 



\\d*tM\ 



< 



< 



s{2e + Af)^-{l-52s)\\D*TM\l 

1-S2S 

(2V2^e)2 + 2 • 2V2se • ^/sJ2^f + sAf^ - (1 - 52s)||^Ti^IIi 



1-5 



2s 
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Notice that by Lemma 13.21 we have 



1 < h'-'^^^''f-^"^" ±\mk\\, 



I 



< 



and 



sM^ - (1 - 52s)\\D*T^h\\\ < [6^(1 -uj) + 52s (1 - 3w/4)2 - (1 - 52s)io^\ \ Y,^ \\D*T^h\\i 

4(1 + 5^2, - 45iJ 



< 



(32 - 2552s) 

where we have used the fact for all 52s G [0, 2/3), 



w(l -uj) + 5',s (1 - "ioj/AY ujil -uj) + 52s (1 - 3w/4)' 

max < 



t^G[o,i] 2 2 



4(2-3^2^) 



2(1 + 52s) ^ 4(1 + 552s - 452J 



16 -952s ~ (32 - 2552s) 
and 

max ^(1 -u:) + 52s (1 - 3a;/4)2 - (1 - 52s)^' < ^ ^"^'^ " ^'^''^^ 



a;e[0,l] ' / -V / . V .s, - (32 - 2552s 

Thus, it follows from the above two inequalities and ()3.7p that 



\\D*Th\\,<^^fi^ + PsY,\\D%h\\,. 

Combining with ()3.ip . one can finish the proof. 

The main result of this subsection is the following theorem. 
Theorem 3.4. //52s < 0.4931, then 

11/ - /lb < go " V + Cie, 



where 



and 



r = 2(2 - 52s) ^ ^ 2 (..C^ 

° l-/,sV (l-'^2s)(32 - 2552s)' ' VT^sK V2 



' 4(1 + 552s -45iJ 
(l-52s)(32 - 2552s)' 
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Proof. By (j3.5p . we have 



\D*h\\l = m^^^h\\l + J2\\D*T,h\\2 
i=2 



< 



Hence, we have 



1-^2. 



2e + 



\ 



i=2 \j=2 I / j=2 



Ihh < 



2e 



+ 



2s) 



2-1 



i=2 



J=2 



Then by lemmas 13.11 and 13.21 we have 



^ 2e v/(2 - ^2s)a^(l - o^) + '^2.(1 - 3a;/4)2 ' 



A direct calculation shows that 



max (2 - S2sMl - c.) + S^sil - Su/Af < ^ f/^ 



It follows from the above two inequalities that 



2e 2 

2 < ^== + 



2(2 -(52s) Viir'* /jll 

' ^ {l-62s){32 -2562s) fr", 



Therefore, with the above inequality and Lemma 13.31 we prove the result. 

3.2 Special case: n < As 

For 52s £ [0, 1), denote that 



{l + hs? 



(3 



By a easy computation, one can show that if 52s < 4\/2 — 5 ?a 0.656, < 1. 

We have / < 3 by n < 4s. For simplicity, we assume that / = 3. Instead of lemmas 12.41 and 
we have the following results. 

Lemma 3.5. We have 



ADD*j,^^h\\i < (1 + 62s)\\DD*T,,h\\i < (1 + 62s)\\D*j,^M- 
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Proof. The proof is straightforward. □ 
Lemma 3.6. We have 

\\ADD*T^^h\\l - \\ADD*T^^^h\\l < (1 + 52s)m,,h\\l - (1 - S2s)m^,M- 

Proof. By the definition of 62s, we have 

\\ADD*T,^^h\\l - \\ADD*j.^^h\\l < (1 + 62s)\\DD*T^^h\\l - (1 - 62s)\\DD*T^^h\\l (3.11) 
Applying (|2.ip to the above yields 

\\ADD*T^^h\\l - \\ADD*j^^^^h\\l < (1 + 62s)m,.M " (1 + ^2s)m,M + 262s\\DD*T,Ml 

< ii + 52s)m^M-(^-^2^)\\DToiHl 

□ 

Similar as Lemma |3.3| we have the following result. 
Lemma 3.7. If n < 4s and 62s < 0.656, then 

i2 II^T.^IIi < T^\\D*f - {D*f%]\\i + jz '^fJ-^ V~se. (3.12) 

Proof. Applying lemmas 13.51 and 13.61 &iid a similar approach as that for ()3.7p yields 

„ ^ {iVTser + 2 • 2V2^£ • y^AA + sAf^ - (1 - 62s)\\D*T,h\\l ,,,,, 

ll-L^To^-lll ^ --, T ) [6.L6) 

where 

AT = Va + S^)\\D*r,,h\\2. 
Notice that by applying Lemma |3. 11 we have 

i=i i=i i=i 

and 

sAA2 - (1 - 52.)||I)^,/i||? < [a;(l - a;)(l + 52s) - (1 - <52s)w'] II^t.^IIi ^ 

2 

52sJ^ ' ^ 



< 



(1 + 5. ^2 / ^ 



Thus, it follows from the above two inequalities and (j3.13p that 

\\D*Thh<^^^ + Psj2\\DTM\i- 
Combining with (j3.ip . one can finish the proof. □ 
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The main result of this subsection is the following theorem. 
Theorem 3.8. If n < As and 62s < 0.656, then 



11/ - /II2 < g jl^*/ ^ ^^^^ ^3_^^^ 



where 



Co = - ^ — . ^ , Ci = —=^^ [ I + ] and ps — ' 



Proof. By a similar approach as that for (j3.9p . we have 



Then by lemmas 13.11 we have 



Therefore, with the above inequality and Lemma 13.71 we prove the result. □ 

Remark 3.9. When D is an identity matrix, that is for the classical RIP and li -minimization 
(Li^e), theorems \&.4\ and \!^.8\ were proved in fT^ . 



4 Recovery via /^-minimization with < q < 1 

In this section, we will discuss recovery of a signal by /^-minimization (Pq.e) with < g < 1. For 
q G (0, 1], let /i = / — /, where / is the solution of {Pq.e) a-nd / is the original signal. We follow the 
same assumptions as in Section 2. Moreover, rearranging the indices if necessary, we assume that 
the first s coordinates of D* f are the largest in magnitude and |x<j+i| > |x|s+2 > • • • > {xal- For the 
rest of this section, for q E (0, 1], we will always assume that = ujYl''j=i II^T^^IIg for some 

nonnegative number uj = uj{q) G [0, 1]. Then we have Yl^j=2 W^Tj^Wt — i'^ ~ ^) X]j=i II^T^^II?- 
Lemma 4.1. For q £ (0, 1], we have 



i=2 \j=i 



2/q 



Proof. By the simple inequality 



ElxA < max \xA \xA^, 
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we have 



j=2 j=2 \ ^ / j=2 

(1 - a;)w(2-9)/g I 



□ 



Lemma 4.2. For q G (0, 1], we have 

Proof. By |261 Lemma 2], we have 
Therefore, we have 



where for the last inequahty we have used ||n||i < ||n||q for n G M'. Combining with Lemma 14. 1^ 
one can conclude the result. □ 

Analogous to (13. ip and (13. 2p . one can prove that 

I 

Y^\\D*r^\\^^<2\\D*T.f\\l + \\D*Th\\l (4.1) 
i=i 

and 

\\Ah\\2 < 2e. (4.2) 

Denote that 



Ps{q) 



2-g V 



'1-52S 22/9(1 - ,^2.) V2-'J2s, 

For 52s < ^, one can prove that there exists a value qq = qo{S2s) £ (0, 1] such that for all q G (0, (;o)) 
Ps{q) < 1- Indeed, by a easy calculation, Ps(g) < 1 is equivalent to 



^2. + ^2^TT(^^3^j <2- 
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Since the second term on the left hand side goes to zero as g — )• 0+ as (^25 < 9 < 1 and 

1 ( 2-q ^ (2-q\'l\ 1 



22/9+1 \2-52sJ ~ V 2 y e 
one can finish the conclusion. 
Lemma 4.3. If 823 < 1/2 and q e {0,qo), then 



1 



; \ 9 2 1 2111 



^ V - {i-pi{q)f'^" '''''' (i-mf'Vir^) 

Proof. Notice that we also have (|3.5p . Using 

o \\Dt h\\f, + \\Dt h\\l 

to (|3.5p . one can get 



.(2-9)/.(2g+AA)2-( l-^2.)P^,fe|| 



l-'52s 

11^ 11, .11 2 



1-S2S 

Notice that by Lemma 14.21 we have 



Q 

q 



1 



and 



sl-^M^ - (1 - 52.)pT,/i||^ < [J^-'^/^l -u;) + 62s - (1 - 52.)a;2/''] ^ 



J "9 

J = l 



2 



where we have used the fact for all 62s G [0, 1), 



(1 - a;)w(2-g)/g ^ (1 - w)a;(2-9)/9 + 52s + ^(2-g)^ ' 

max 7- — < ~ 



9 / 2 - g 



,2-5 2(2-9)/'? 



< 52s + 



22/9 \2-62s 



15 



and 

max a;(2-9)/9(l - u) + 62s - (1 - 62s)uj^^'' 
we[o,i] 

< - + - (1 - = ^2. + ^ (^'^ 

Thus, it follows from the above two inequalities and (j4.4[) that 

\--- / I \ ^ 

Therefore, we get 

where we have used (|a| + < \a\'' + |6|''. Plug the above inequality to ()4.ip and by a easy 
computation, one can show that 

j=i ^-ps(q) (1- (52s) 2(1-^3(9)) 

Using the basic inequality ||f||g<29 for u G to the above inequality, one can finish the 

proof. □ 

The main result of this subsection is the following theorem. 
Theorem 4.4. //52s < ^, then there exists a value qo = qo{S2s) G (0, 1] such that for any q € (0, qo), 



/ \ /'^2s , q f 2 - q \i ^ 



Furthermore, 



11/ - /II2 < Co " , + Cie, (4.5) 



si 2 

where 



(l-pl(9))"»V l-*2" VT^V 

Proof. Notice that we also have ()3.9p . Using lemmas 14.11 and 14.21 to ()3.9p , we get 

1 

<3 



< 2e (2-52s)(2-g)(^-'')N + 22/g52s ( n p. ,||. 

Tr^^V (1 - <52s)2v..(2-.)/. \l^\\D^h\\. 



1 

1 
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where we have used 

max (2 - 62s)(l - uj)J^'''^/'' < (2 - 52s)(l - uj)J^-''^/''\ 2-,. 
we[o,i] 1'^-— 

Now the proof can be finished by directly applying Lemma l4.3i □ 



Remark 4.5. When D is an identity matrix, that is for the classical RIP and Iq-minimization 
(Lq^e), Theorem \4-4\ was shown in f26V. 
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